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Scope of Work 

This report provides results of an independent assessment of the geopositional accuracy 
of the Earth Satellite (EarthSat) Corporation’s GeoCover™ orthorecti lied Landsat 
Thematic Mapper (TM) imagery over Northeast Asia. This imagery was purchased 
through NASA’s Earth Science Enterprise (ESE) Scientific Data Purchase (SDP) 
program. 

Background 

The EarthSat data procured through the SDP was orthorectified using a small set of 
scenes within a large geographic region, or block. Each of these scenes contained 
government provided ground control coordinates. A geometric model of the block was 
created based on the controlled scenes. This model was then applied to the rest of the 
scenes in the block. 

Approach 

The orthorectified Landsat TM imagery’s geopositional accuracy was estimated using a 
standard procedure that utilizes geodetic control points provided by the U.S. government. 
The approach was to use a small sample of independently controlled scenes to estimate 
the horizontal geopositional accuracy of the orthorectified products and to compare that 
estimate to the geopositional accuracy specified by NASA contract NAS 13-98046 with 
the Earth Satellite Corporation. The contract specifies that the orthorectified TM product 
shall have a geopositional Root Mean Square Error (RMSE) accuracy of 50 meters. 

Dataset 


Six Landsat TM scenes over the Northeast Asia region were used in this activity. The 
selection of scenes used for the validation was dependent upon the availability of 
geodetic ground control points. Appendix A contains a map showing the location of the 
scenes used for validation in relation to the entire block processed by Earth Satellite 
Corporation. Earth Science Applications (ESA) Directorate personnel imported each 
orthorectified TM scene from GeoTIFF format to ERDAS IMAGINE format. Analysts 
used ERDAS IMAGINE software to analyze each 7-band scene. 

Geodetic Control Reference Data 


The U.S. government provided a set of geodetic control points for use in this assessment. 
This ground control infonnation was available only for specific parts of the globe. Of the 
available points, selected points were omitted as described in the Procedure section 
below. The control information was available in the form of both hardcopy 
documentation and softcopy computer files that duplicated the hardcopy coordinate 
documentation. The softcopy version enabled the importing of control point reference 
data into image processing software with minimal opportunities for error. 
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Table 1 provides scene-specific information for the Landsat TM scenes used in this 
assessment, including TM path/row identifiers, acquisition dates, the total number of 
control points available, and the total number of control points used in the validation 
activity for each scene. (Note: These test points were used only in this validation and not 
in Earth Satellite Corporation ’s orthorectification process.) 


Table 1. Geodetic Control Point Information 


Scene Path/Row 

Acquisition Date 

Number of Control 
Points Available 

Number of Control 
Points Used 

114/34 

9/27/1987 

13 

5 

115/31 

9/29/1991 

13 

10 

116/34 

5/17/1989 

12 

9 

116/36 

9/22/1992 

12 

9 

117/33 

6/1/1992 

16 

9 

126/25 

8/3/1 989 

14 

7 

Total 


80 

49 


Procedure 


The first step was to process the data using the Ground Control Point (GCP) Editor 
function available in the ERDAS IMAGINE image processing software. For each scene, 
the control Point ID, the X-Coordinate (UTM-East), and the Y-Coordinate (UTM -North) 
were entered into a comma-delimited ASCII file and then imported into the GCP Editor’s 
Point ID, X-Reference, and Y-Reference fields. This action caused ground control point 
markers to appear on the image displayed in the reference viewer. The resulting image 
served as a reference dataset for checking geopositional accuracy and for determining 
approximately where each control point fell within an image. The analyst then used a 
separate ERDAS IMAGINE viewer to zoom in and to locate the feature associated with a 
control point on the given Landsat TM scene using a control diagram and descriptive 
remarks to place the test points in the proper location. This action populated the X-Input 
and Y-Input fields in the software’s GCP editor. If the analyst could not discern the 
proper location or if the point fell outside the imagery’s geographical extent, the point 
was omitted. The remaining points served as the input. 

After selecting the usable control points, the analyst exported an ASCII file that 
contained the Point IDs, the input coordinates, and the reference coordinates for each 
scene examined. Because most of the ASCII files contained fewer than 20 test points, and 
because the Federal Geographic Data Committee recommends a sample size of at least 20 
points, the files for individual scenes were combined into one large file. This file 
provided the input required to execute a Visual Basic program that computes X- 
differences and Y-differences and that estimates geopositional accuracy. For each point, 
the Visual Basic program computed the X-differences and Y-differences, the squares of 
the X-differences and Y-differences, the X-RMSE and Y-RMSE, and the net RMSE 
(accuracy) using the following accuracy fonnulas: 
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where X input , Y input are the coordinates of the input points; X contro i, Y contro i are the 
coordinates of the reference points; and n is the total number of usable control points. 

Results 


The calculations shown in Appendix B indicate that the RMSE, or net horizontal 
displacement, of the Northeast Asia GeoCover™ orthorecti lied TM imagery block is 
35.39 meters. 

Appendix C provides a cartographic representation showing the locations of the scenes 
used in validating the Northeast Asia GeoCover orthorectified TM imagery block. This 
cartographic output, derived from a government-provided, vector-based program, shows 
overall error within each scene used in the validation via a resultant vector. The resultant 
vector’s length represents the overall magnitude of error. The direction of the resultant 
vector is the overall direction of error. 

Limitations 


Sample size and selection of test points were dependent upon the quantity, quality, and 
utility of the data available. These test points were selected from surplus ground control 
information that is available only for certain parts of the globe. 

The possibility exists for inherent analyst bias because of the variability in image 
interpretation and pattern recognition capabilities. Final selection of points reflected user 
subjectivity. 
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Appendix A 



Northeast Asia TM Coverage 
Validated scenes appear highlighted in yellow. 
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Appendix B 


Accuracy Computations for Northeast Asia Block GeoCover™ 
(all measurements in meters) 


Number 

X (geocover) 

X (Control) 

diff in X 

squared 
diff in X 

Y (geocover) 

Y (control) 

diff in Y 

squared 
diff in Y 

11403408 

516748.92 

516727.94 

- 20.99 

440.39 

4143085.44 

4143088.62 

3.18 

10.10 

11403410 

497312.68 

497323.56 

10.87 

118.24 

4085541.59 

4085488.19 

- 53.40 

2851.35 

11403412 

537224.86 

537187.44 

- 37.42 

1400.56 

4101234.20 

4101239.78 

5.58 

31.09 

11403417 

658750.48 

658742.84 

- 7.64 

58.29 

4154418.38 

4154455.88 

37.50 

1406.55 

11403418 

658835.27 

658853.17 

17.90 

320.55 

4152978.11 

4153011.84 

33.73 

1137.71 

11503001 

632416.90 

632400.76 

- 16.14 

260.56 

4691556.39 

4691584.06 

27.67 

765.63 

11603105 

516764.89 

516772.10 

7.21 

52.01 

4672743.85 

4672761.35 

17.50 

306.08 

11503105 

557658.01 

557661.11 

3.11 

9.64 

4663712.16 

4663704.41 

- 7.75 

60.12 

11603109 

452452.87 

452470.36 

17.49 

305.77 

4640469.66 

4640483.48 

13.83 

191.16 

11603110 

475792.69 

475774.16 

- 18.53 

343.53 

4623398.52 

4623416.49 

17.98 

323.21 

11503102 

568872.07 

568865.51 

- 6.56 

43.08 

4625394.78 

4625419.03 

24.25 

588.11 

11503103 

566480.08 

566443.05 

- 37.03 

1371.32 

4582042.64 

4582076.84 

34.20 

1169.64 

11503132 

560934.06 

560920.84 

- 13.22 

174.77 

4704148.10 

4704159.80 

11.69 

136.75 

11503134 

457539.96 

457535.45 

- 4.51 

20.35 

4602240.48 

4602245.56 

5.08 

25.84 

11503135 

518358.08 

518338.19 

- 19.90 

395.84 

4595382.03 

4595411.40 

29.37 

862.66 

11603311 

318298.53 

318352.96 

54.42 

2961.87 

4230465.08 

4230430.93 

- 34.15 

1166.15 

11603312 

396593.21 

396597.36 

4.15 

17.22 

4212481.62 

4212474.99 

- 6.64 

44.08 

11603408 

323407.43 

323376.51 

- 30.93 

956.57 

4106158.03 

4106126.58 

- 31.45 

988.91 

11603409 

369688.34 

369698.45 

10.11 

102.18 

4110568.60 

4110527.08 

- 41.52 

1724.33 

11603410 

247195.59 

247178.03 

- 17.56 

308.47 

4075970.05 

4075988.06 

18.01 

324.40 

11603411 

310391.98 

310365.38 

- 26.60 

707.66 

4064470.28 

4064509.45 

39.16 

1533.58 

11603402 

210047.83 

210021.15 

- 26.69 

712.30 

4172944.21 

4172955.71 

11.50 

132.20 

11603403 

308940.11 

308924.61 

- 15.50 

240.26 

4181405.50 

4181404.22 

- 1.28 

1.65 

11703420 

231418.65 

231395.24 

- 23.41 

548.16 

4119531.13 

4119565.93 

34.80 

1210.83 

11603601 

773188.95 

773195.20 

6.25 

39.06 

3915802.44 

3915800.34 

- 2.09 

4.39 

11603602 

700441.34 

700444.88 

3.54 

12.50 

3838068.48 

3838084.00 

15.51 

240.72 

11603603 

758114.83 

758067.86 

- 46.97 

2206.01 

3834016.93 

3834056.39 

39.46 

1556.93 

11603604 

692252.64 

692216.92 

- 35.73 

1276.40 

3772473.30 

3772504.67 

31.37 

984.33 

11603605 

771580.69 

771569.86 

- 10.83 

117.31 

3781652.35 

3781679.18 

26.83 

720.12 

11603517 

802575.86 

802533.81 

- 42.05 

1768.60 

3907193.11 

3907198.39 

5.28 

27.84 

11603519 

840179.81 

840171.04 

- 8.78 

77.00 

3904137.58 

3904136.72 

- 0.86 

0.74 
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11503602 

815630.16 

815620.30 

-9.86 

97.26 

3854669.80 

3854643.09 

-26.71 

713.16 

11503606 

800251.62 

800272.10 

20.48 

419.41 

3765847.51 

3765831.37 

-16.14 

260.47 

11603310 

766123.76 

766131.28 

7.53 

56.69 

4241084.84 

4241046.89 

-37.95 

1440.35 

11703401 

663694.03 

663658.69 

-35.33 

1248.44 

4236411.21 

4236429.15 

17.94 

321.70 

11703402 

714051.03 

714060.58 

9.55 

91.23 

4227559.68 

4227536.70 

-22.98 

528.17 

11703216 

718230.15 

718214.57 

-15.59 

242.91 

4393385.13 

4393382.73 

-2.40 

5.75 

11703218 

802173.89 

802169.56 

-4.33 

18.77 

4378084.88 

4378100.22 

15.34 

235.28 

11703302 

637217.73 

637157.66 

-60.07 

3608.38 

4365870.24 

4365870.67 

0.43 

0.18 

11703303 

701385.56 

701407.77 

22.21 

493.47 

4342913.94 

4342909.30 

-4.63 

21.47 

11703306 

654290.34 

654299.23 

8.89 

79.02 

4265124.30 

4265148.89 

24.59 

604.91 

11703307 

780300.43 

780283.73 

-16.69 

278.72 

4215462.08 

4215437.80 

-24.28 

589.52 

12602504 

338407.00 

338390.40 

-16.60 

275.43 

5619119.22 

5619072.35 

-46.87 

2196.61 

12602505 

418229.49 

418225.44 

-4.05 

16.40 

5605613.53 

5605622.70 

9.16 

83.94 

12602508 

405487.89 

405506.61 

18.72 

350.43 

5556489.85 

5556477.37 

-12.48 

155.85 

12602507 

317879.40 

317850.50 

-28.91 

835.71 

5573767.22 

5573722.85 

-44.38 

1969.14 

12602510 

308170.93 

308123.36 

-47.56 

2262.36 

5509366.74 

5509410.35 

43.61 

1901.66 

12602512 

458318.07 

458286.13 

-31.94 

1020.39 

5474326.50 

5474345.02 

18.52 

342.95 

12702506 

385416.64 

385395.23 

-21.41 

458.22 

5587452.10 

5587436.56 

-15.55 

241.68 


Sum 

29219.69 


Sum 

32139.99 

Average 

596.32 


Average 

655.92 

RMSEx 

24.42 


RMSEy 

25.61 


RMSE Net 35.39 meters. 


Page 7 of 8 





EarthSat Thematic Mapper Validation - Northeast Asia 


Appendix C 
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